9 / 17/2018 
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6.1.6 Solved Problems 

Problem 1 

LetX, Y and Zbe three jointly continuous random variables with joint PDF 

{1 

j(x + 2y + 3 z) 0 < x,y, z < 1 

0 otherwise 


Find the joint PDF of X and Y, fxy(x, y). 
• Solution 


roo 

fxfc>y) = J -JxY^xy^ z ) dz 


•i i 


jo t( x + 2 y + 3z V z 


3 ■> 1 

(x + 2y)z + -z 2 


0 


3\ X + 2y+ 2 


for 0 < x,y < 1. 


Thus, 


Ux + 2y+ 3 - 


fxyixy) = 


0 <x < l,0<y< 1 


otherwise 


Problem 2 

LetX, Y and Zbe three independent random variables withX ~ N(ju, a 1 ), and 
Y, Z ~ Uniformed, 2). We also know that 

E\X 2 Y+XYZ\ = 13, 

E[XY 2 + ZX 2 ] = 14. 
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Find u and a. 

• Solution 


O 


X, F, and Z are independent => 

Since Y,Z ~ Uniform(0, 2), we conclude 
EY= EZ= 1; Var(F) 


(EX 2 ■ EY+EX- EY- EZ= 13 
| EX • EY 2 + EZ ■ EX 2 = 14 


= Var(Z) 


(2 ~ 0) 2 

12 


1 

3' 


Therefore, 


Thus, 



4 

3' 


EX 2 + EX = 13 

4 ? 

3 EX+ EX~ = 14 


We conclude EX = 3, EX 2 = 10. Therefore, 


| H 2 + tr = 10 

So, we obtain // = 3,cr = 1. 


Problem 3 

Let X |, 3f 2 , andX 3 be three i.i.d Bernoulliip) random variables and 

T| = max (X l ,X 2 ), 

Y 2 = max (X 1 ,X 3 ), 

F 3 = max (X 2 ,X 3 ), 

F=Ti + T 2 + F 3 . 

Find EY and Var(F). 
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• Solution 

o We have 

EY = EY X + EY 2 + EY 3 = 2>EY X , by symmetry. 

Also, 

Var(7) = Var(7j) + Var(F 2 ) + Var(F 3 ) + 2Cov(F 1 , F 2 ) + 2Cov(F 1 , F 3 ) + 2Cov(F 2 , F 3 ) 


= SVa^Fj) + 6Cov( Fj, F 2 ), by symmetry. 

Note that Y- s are also Bernoulli random variables (but they are not independent). In 
particular, we have 

P(F 1 = l)=P((X 1 = l)or(X 2 = l)) 

= P(X j = 1) + P(X 2 = 1) - P(X i = l,X 2 = 1) (comma means “and”) 

= 2 p~p 2 . 

2 

Thus, Y l ~ Bemoulli(2p - p ), and we obtain 
EY\ = 2 P ~ P 2 = P( 2 ~ P), 

Var(Fj) = (2 p - p 2 ){ 1 - 2 p + p 2 ) = p(2 -p){ 1 -/?) 2 . 

It remains to find Cov(F 1 , F 9 ). We can write 

Cov(Y l ,Y 2 )=E[Y l Y 2 ]-E[Y l ]E[Y 2 ] 

= E[Y l Y 2 \-p\2-p) 2 . 


Note that Fj F 2 is also a Bernoulli random variable. We have 


£[F 1 F 2 ]=P(F 1 = 1,F 2 =1) 

= P((X 1 = l)or(X 2 =l,X 3 =l)) 

= P(X ] = 1 ) + P(X 2 = l,X 3 = 1 )~P(X l = 1,X 2 = 1,X 3 = 1) 
= p + p - p . 

Thus, we obtain 

Cov(F 1 ,F 2 ) = £[F 1 F 2 ]-^ 2 (2-^) 2 

= p + p 2 ~ p 2 ~ p 2 (2 ~ p) 2 . 


Finally, we obtain 
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Also, 


EY= 3 EY l = 2p{2 ~ p). 


Var(T) = 3 Var( 7j) + 6Cov( 7,, Y 2 ) 

= 3p(2 -p)( 1 -p) 2 + 6(p+p 2 - p 3 ~ p 2 (2 -p) 2 ). 


Problem 4 

Let Mj^s) be finite for 5 6 [ - c, c], where c > 0. Show that MGF of 7 = aX + b is given by 

My(s ) = e sb M^(as), 


audit is finite in ■ 

• Solution 

o We have 

My(s) = E[e sY ] 

= E[e saX e sb ] 

= e sb E[e^ sa)X ] 
= e sb M^{as). 


Also, since M^s) is finite for .v E [ 


c, c ], Myias) is finite for s 6 


c c 

\ a I ’ I«I 


Problem 5 

Let Z ~ /V(0, 1) Find the MGF of Z. Extend your result to A ~ N(u, a). 

• Solution 

o We have 
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M^s) = E[e sZ ] 


27T 

roo 

1 —00 

2 r/x 

1 , 

s 2 

poo _ _ 

(*-*) : 


e 2 e 

1 —00 

2 

d 1 f 00 

(x-s) : 

- e 2 ,— e 

"°° 

2 


= e 2 (PDF of normal integrates to 1). 
Using Problem 4, we obtain 


M^s) = e SfJ+ T, for all s E R. 


Problem 6 

Let Y = X l + X 2 + X 3 + ... + X n , where X-s are independent and X i ~ Poisson(X t ). Find the 
distribution of Y. 

• Solution 

o We have 


M x (s) = e A ‘ (gS l} , for all s E R. 


Thus, 


m/s)= n ^ ,(e? 1} 

i= 1 

= e ( ( e for all s E R. 

which is the MGF of a Poisson random variable with parameter X = £” = \X-, thus 

n 

Y ~ Poissonj y X,). 

i= 1 


Problem 7 

Probability Generating Functions (PGFs): For many important discrete random variables, the 
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range is a subset of {0, 1,2,...}. For these random variables it is usually more useful to work with 
probability generating functions (PGF)s defined as 


G x (z) = E[Z X ] = 


00 


J J P(X= n)Z", 

n = 0 


for all Z 6 R that G X (Z) is finite. 


1. Show that G X (Z) is always finite for \Z\ < 1. 

2. Show that if X and Y are independent, then 

G X+Y (Z) = G x iZ)G } lZ). 


3. Show that 


4. Show that 


1 d k G£z) 
ki dz k 1 " =0 


P(X= k). 


d k Gx(z) 

—— | z=1 = E[X(X~ 1)(X- 2)... (X-k + 1)]. 
dz 


• Solution 

o 1. If |Z| < 1, then Z" < \Z\ < 1, so we have 


G x (z)=Y J P{X=n)Z" 

n = 0 

00 

< 2>(x=«) = i. 

n =0 


2. If X and Y are independent, then 

G X+} (Z) = E[Z X+Y ] 

= E[Z x Z y ] 

= E[Z X ]E[Z ) ] (since X and Y are independent) 
= G^GyiZ). 

3. By differentiation we obtain 
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d k G^z) 

dz k 


X n(n - 1 )(n - 2)... (n ~ k + 1)P(X = «)Z” _A: . 

n = k 


Thus, 


<^z) 

dz k 


00 

A- !P(X = it) + X "0 - 1)0 -2)... (n-k+ 1 )P(X = n)Z n 

n = k+ 1 


Thus, 


i d k a/z) . 

*! L "° 


P(X= k). 


4. By letting Z = 1 in 


d k G£z) 

dz k 


00 

X «0 - 1)0 -2)...(n-k + \ )P(X = n)Z n ~ k , 

n = k 


we obtain 


d k G^z) 
dz k lz=1 


00 

y, «0 _ 1)0 _ 2).. . 0 _ k + 1 )P(X = n), 

n=k 


which by LOTUS is equal to E[X{X~ 1)(X- 2)... (X— k + 1)]. 


Problem 8 

Let MjAs) be finite for s 6 [ - c, c] where c > 0. Prove 


lim 

n —> go 


m*(-) 


= 


• Solution 

o Equivalently, we show 


lim //In 

«—>00 



,v£X 


We have 
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lim win 

n —>oo 





lim ■ 

n —> go 


0 

o' 


So, we can use L'Hopital's rule 


ln ( M ^»)) ln(My(te)) j 

lim -:- = lim - (let t = ~) 

l—yco _ /—>0 ^ 77 


sM x (ts ) 

M x ( ts) 

= lim - (by L'Hopital's rule) 

/—>o 1 

0) 


M%(0) 

= sju (since M^(0) = ju, M^(0) = 1). 


Problem 9 

Let M^s) be finite for s 6 [ - c, c], where c > 0. Assume EX = 0, and Var(A) = 1. Prove 


lim 

n —>oo 


' 

s 

' 

M x 

~r 


. 

yyjn) 

. 


n 

= e 2 . 


Note: From this, we can prove the Central Limit Theorem (CLT) which is discussed in Section 

7.1. 

• Solution 

o Equivalently, we show 


s \ s' 

lim //InI M —j=) = 

11 —> 00 \ V 77 


We have 
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lim nln Mj{—p) 
■\jn 




= lim ■ 

n —>oo 


(let t j ) 

A/« 


In 


= lim 




f-o r 

sM x (ts) 


= lim 

/—>0 


= lim 

/—>0 


= lim 

/—>0 

_2 


M^( /s) 
27 

sM^ts) 


It 


2 M^ts) 


(by L'Hopital's rule) 


(again -,) 


(by L'Hopital's rule) 


— (since 0) = £X 2 = 1) 


Problem 10 

We can define MGF for jointly distributed random variables as well. For example, for two 
random variables ( X , Y), the MGF is defined by 

M^s, t) = E[e sX+tY ]. 

Similar to the MGF of a single random variable, the MGF of the joint distributions uniquely 
determines the joint distribution. Let X and Fbe two jointly normal random variables with 

EX = n x , EY = fi Y , Var(X) = a x Var (Y) = a Y , p(X, Y) = p . Find M XY (s, t). 


• Solution 

o Note that U = sX + /F is a linear combination of X and Y and thus it is a normal 
random variable. We have 

EU = sEX + tEY = sp x + t/t Y , 

Var( U) = ,v 2 Var(W) + / 2 Var( Y) + 2 stp(X, Y)g x cj y 

= s 2 (J x + t 2 o Y + 2stpcJ x a y. 


Thus 
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2 2 ? 2 

U ~ N(sfi x + tjU Y , s a x + ray + Istpa^Oy). 

Note that for a normal random variable with mean u and variance a~ the MGF is 

2 2 

given by e S! ' + 2 .Thus 

Mxy( s ’ 0 = E[e u ] = MfJX) 

= e^ l u + 2 

1 ? 2 o 2 

_ e Sfl x +tfly + 2 ( s °x +t 


Problem 11 


Let X 



be a normal random vector with the following mean vector and covariance matrix 


Let also 



‘O' 

r 

m = 

1 

,c = 



■i 

2 ■ 


'O' 


'V 

2 

1 

,b = 

1 

,Y = 

^2 

1 

1 


2 


^3 


AX + b. 


a. Find P(0 < X 2 < 1). 

b. Find the expected value vector of Y, m Y = EY. 

c. Find the covariance matrix of Y, C Y . 

d. Find P(Y 3 < 4). 


• Solution 

o (a) From m and c we have X 2 ~ N( 1, 2). Thus 
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P(0 < X 2 < 1) = o 


1 -1 


-o 


o-l 


^ 1V2 


(b) 


= O(0)-o|-ji | = 0.2602 


m Y =EY=AEX+b 


■1 

2- 


■o ■ 


■0- 

2 

1 


1 

+ 

1 

1 

1 



2 


(c) 


C Y = AC r 4 ] 


1 2 
2 1 
1 1 


r i -i 

-1 2 


r i 2 i 
2 1 1 


5 1 2 
1 2 1 
2 1 1 


(d) From m Y and c Y we have Y-, ~ /V(3, 1), thus 


P(Y 3 < 4) = O 


'4-3 


= 0(1) = 0.8413 


Problem 12 

(Whitening/decorrelating transfomiation) Let X be an //-dimensional zero-mean random vector. 
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Since C x is a real symmetric matrix, we conclude that it can be diagonalized. That is, there exists 
an n by n matrix Q such that 


T 

QQ = I (7 is the identity matrix), 
C x =QDQ t , 


where D is a diagonal matrix 


' d \\ 0 
0 d 22 


D = 


0 < 

0 


0 0 


d,„ 


T 

Now suppose we define a new random vector Y as Y = Q X, thus 

X= QY. 

Show that Y has a diagonal covariance matrix, and conclude that components of Y are 
uncorrelated, i.e., Cov(F ; -, Y) = 0 if i ± j. 

• Solution 

° C Y = E[(Y - EY)(Y - EY) t ] 

= E[(Q t X- EQ t X)(Q t X-EQ t X ) t ] 

= E[Q t (X~ EX)(X~ EX) t ]Q] 

= Q T C x Q 

= q t qdq t q 

= D (since Q T Q = I). 

Therefore, Y has a diagonal covariance matrix, and Cov(T,-, Yd = 0 if / 7 j- 

l J 


<— previous 
next —» 
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